Information suggestion system, information suggestion method, program, and recording medium

ABSTRACT

Provided are an information suggestion system, an information suggestion method, a program, and a recording medium capable of suggesting information of interest to many users to a product provider related to the information from an image group of a plurality of users. 
     In the information suggestion system, the information suggestion method, the program, and the recording medium, an image group acquisition unit acquires an image group of a plurality of users, and an image analysis unit detects an imaging location of each image and an object appearing in each image. An imaging number count unit counts an imaging number of same-type images which are captured at the same imaging location and in which the same object appears, and an imaging frequency calculation unit calculates an imaging frequency of the same-type images. An information suggestion unit suggests same-type image information related to the same imaging location and the same object of the same-type image of which the imaging number and the imaging frequency satisfy a predetermined condition to a product provider related to the same-type image information.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a Divisional of U.S. patent application Ser.No. 16/896,958 filed on Jun. 9, 2020, which claims priority under 35U.S.C. § 119 to Japanese Patent Application No. 2019-124384, filed onJul. 3, 2019. The above application is hereby expressly incorporated byreference, in its entirety, into the present application.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates to an information suggestion system, aninformation suggestion method, a program, and a recording medium forsuggesting information on a product to a user and suggesting informationfor suggesting the information on the product to the user to a productprovider.

2. Description of the Related Art

There are considerably many related arts as a technology for suggestinginformation related to purchase of a new product to a user based on apurchase history and a browsing history of the user.

For example, JP2013-161116A describes a recommendation system thatassociates identification information of contents (image and motionpicture), an image of a product, and person information (age and gender)of a user included in the contents with each other, and recommendsproduct information in consideration of the person information of theuser.

JP2011-141892A describes a recommendation system that outputsinformation corresponding to identification information of an articlecategory other than an article category related to an article includedin an image among article categories related to a category correspondingto an article category related to an article included in the image.

JP2017-076315A describes an image processing device that estimates atendency of clothes of a person while referring to a plurality ofcaptured images of the person, selects the clothes related to the personamong a plurality of clothes based on the estimated tendency of theclothes of the person, and outputs information on the selected clothes.

JP2018-005843A describes an image processing device that analyzes animaging location and analyzes a subject other than a person appearing inan image for a plurality of images uploaded from terminal devices of aplurality of users and gives tag information in a case where the numberof images captured at the same location or a location within apredetermined range exceeds a threshold value.

JP2017-010251A describes an image extraction device that analyzes imagefeatures of an image including features such as the number ofappearances of an object, an imaging frequency, and the number of timesof imaging at each imaging location for an image group uploaded to aserver by a user.

JP2015-060288A decides an advertisement selection device that analyzestendencies related to imaging locations of a plurality of images andselects a predetermined number of advertisements from advertisementsregistered in advance based on an analysis result.

SUMMARY OF THE INVENTION

However, there are no related arts for suggesting information on aproduct related to purchase of the product from an analysis result of animage group of a user stored in a storage such as an online storage, andsuggesting information for suggesting the information on the product tothe user to a product provider who suggests the information on theproduct to the user and sells the product to the user as will besuggested by the present invention.

For example, an image published on a social networking service (SNS) isintended to transmit information to other users from the beginning. Incontrast, the image group stored in the online storage includes moreprivate feelings with close family members and friends. Therefore, it isconsidered that a suggestion of information different from a suggestionof information from an image published on SNS can be realized from theimage group stored in the online storage.

Therefore, an object of the present invention is to provide aninformation suggestion system, an information suggestion method, aprogram, and a recording medium capable of suggesting information ofinterest to many users to a product provider related to this informationfrom image groups of a plurality of users.

In order to achieve the aforementioned object, the present inventionprovides an information suggestion system comprising an image groupacquisition unit that acquires image groups of a plurality of usersstored in an online storage, an image analysis unit that detects animaging location of each image included in the image groups of theplurality of users and an object appearing in the each image byanalyzing the each image, an imaging number count unit that counts animaging number of a same-type image for each of same-type images whichare captured at a same imaging location and in which a same objectappears in the image groups of the plurality of users, an imagingfrequency calculation unit that calculates an imaging frequency of thesame-type images from the imaging number of the same-type images foreach of the same-type images in the image groups of the plurality ofusers, and an information suggestion unit that suggests same-type imageinformation related to the same imaging location and the same object ofa same-type image of which the imaging number and the imaging frequencysatisfy a predetermined condition to a product provider related to thesame-type image information among a plurality of product providers.

The information suggestion system further comprises a region informationreception unit that receives information on a region which is providedfrom each of the plurality of product providers and corresponds to atleast one region of a geographical region or a business region in whichthe same-type image information is desired. It is preferable that theinformation suggestion unit suggests the same-type image information ofthe same-type image of which the imaging number and the imagingfrequency satisfy the predetermined condition to a product provider whoprovides information on a region corresponding to a region including atleast one of the same imaging location or the same object of thesame-type image of which the imaging number and the imaging frequencysatisfy the predetermined condition.

The information suggestion system further comprises an image extractionunit that extracts, as a region-related image, an image related to theinformation on the region from the image groups of the plurality ofusers. It is preferable that the imaging number count unit counts theimaging number of the same-type images for each of the same-type imagesin the region-related image or for attributes of the plurality of usersin the region-related image and the imaging frequency calculation unitcalculates the imaging frequency of the same-type images from theimaging number of the same-type images for each of the same-type imagesin the region-related image or for the attributes of the plurality ofusers in the region-related image.

It is preferable that the image extraction unit extracts, as theregion-related image, an image in which information related to at leastone of an imaging location of the image or an object appearing in theimage is related to the information on the region.

It is preferable that the attributes of the plurality of users includeat least one of ages, years of birth, genders, or addresses of theplurality of users.

The information suggestion system further comprises a suggestiondecision unit that decides whether or not to suggest the same-type imageinformation to the product provider related to the same-type imageinformation depending on whether or not the imaging number and theimaging frequency of the same-type images satisfy the predeterminedcondition in the region-related image or the attributes of the pluralityof users in the region-related image. It is preferable that theinformation suggestion unit suggests the same-type image informationdecided to be suggested to the product provider related to the same-typeimage information decided to be suggested.

The information suggestion system further comprises a suggestion draftcreation unit that creates a suggestion draft including informationrelated to the same object of the same-type image of which the imagingnumber and the imaging frequency satisfy the predetermined condition anda condition for suggesting the same-type image information of thesame-type image of which the imaging number and the imaging frequencysatisfy the predetermined condition to one or more users. It ispreferable that the information suggestion unit transmits the suggestiondraft to the product provider related to the same-type image informationof the same-type image of which the imaging number and the imagingfrequency satisfy the predetermined condition.

It is preferable that the information suggestion unit suggestinformation on a product related to the same-type image information toone or more users based on a condition which is provided from each ofthe plurality of product providers and for suggesting the information onthe product related to the same-type image information to the one ormore users.

It is preferable that in a case where a predetermined period elapsesafter the same-type image of which the imaging number and the imagingfrequency satisfy the predetermined condition is previously uploaded tothe online storage in one image group of one user, the informationsuggestion unit suggests to the product provider related to thesame-type image information of the same-type image of which the imagingnumber and the imaging frequency satisfy the predetermined condition tosuggest information on a product related to the same-type imageinformation of the same-type image of which the imaging number and theimaging frequency satisfy the predetermined condition to the one user.

It is preferable that in a case where the imaging number and the imagingfrequency of the same-type images satisfy the predetermined condition inthe image groups of the plurality of users, the information suggestionunit suggests to the product provider related to the same-type imageinformation of the same-type image of which the imaging number and theimaging frequency satisfy the predetermined condition to suggestinformation on the product related to the same-type image information ofthe same-type image of which the imaging number and the imagingfrequency satisfy the predetermined condition to a similar-attributeuser which does not upload the same-type image of which the imagingnumber and the imaging frequency satisfy the predetermined condition andhas an attribute similar to the plurality of users.

The present invention provides an information suggestion methodcomprising acquiring, by an image group acquisition unit, image groupsof a plurality of users stored in an online storage, detecting, by animage analysis unit, an imaging location of each image included in theimage groups of the plurality of users and an object appearing in theeach image by analyzing the each image, counting, by an imaging numbercount unit, an imaging number of a same-type image for each of same-typeimages which are captured at a same imaging location and in which a sameobject appears in the image groups of the plurality of users,calculating, by an imaging frequency calculation unit, an imagingfrequency of the same-type images from the imaging number of thesame-type images for each of the same-type images in the image groups ofthe plurality of users, and suggesting, by an information suggestionunit, same-type image information related to the same imaging locationand the same object of a same-type image of which the imaging number andthe imaging frequency satisfy a predetermined condition to a productprovider related to the same-type image information among a plurality ofproduct providers.

In the information suggestion method further comprises receiving, by aregion information reception unit, information on a region which isprovided from each of the plurality of product providers and correspondsto at least one region of a geographical region or a business region inwhich the same-type image information is desired. It is preferable thatthe same-type image information of the same-type image of which theimaging number and the imaging frequency satisfy the predeterminedcondition is suggested to a product provider who provides information ona region corresponding to a region including at least one of the sameimaging location or the same object of the same-type image of which theimaging number and the imaging frequency satisfy the predeterminedcondition.

The information suggestion method further comprises extracting, by animage extraction unit, as a region-related image, an image related tothe information on the region from the image groups of the plurality ofusers. It is preferable that the imaging number of the same-type imagesis counted for each of the same-type images in the region-related imageor for attributes of the plurality of users in the region-related imageand the imaging frequency of the same-type images is calculated from theimaging number of the same-type images for each of the same-type imagesin the region-related image or for the attributes of the plurality ofusers in the region-related image.

It is preferable that an image in which information related to at leastone of an imaging location of the image or an object appearing in theimage is related to the information on the region is extracted as theregion-related image.

It is preferable that the attributes of the plurality of users includeat least one of ages, years of birth, genders, or addresses of theplurality of users.

The information suggestion method further comprises deciding, by asuggestion decision unit, whether or not to suggest the same-type imageinformation to the product provider related to the same-type imageinformation depending on whether or not the imaging number and theimaging frequency of the same-type images satisfy the predeterminedcondition in the region-related image or the attributes of the pluralityof users in the region-related image. It is preferable that thesame-type image information decided to be suggested is suggested to theproduct provider related to the same-type image information decided tobe suggested.

The information suggestion method further comprises creating, by asuggestion draft creation unit, a suggestion draft including informationrelated to the same object of the same-type image of which the imagingnumber and the imaging frequency satisfy the predetermined condition anda condition for suggesting the same-type image information of thesame-type image of which the imaging number and the imaging frequencysatisfy the predetermined condition to one or more users. It ispreferable that the suggestion draft is transmitted to the productprovider related to the same-type image information of the same-typeimage of which the imaging number and the imaging frequency satisfy thepredetermined condition.

It is preferable that information on a product related to the same-typeimage information is suggested to one or more users based on a conditionwhich is provided from each of the plurality of product providers andfor suggesting the information on the product related to the same-typeimage information to the one or more users.

It is preferable that in a case where a predetermined period elapsesafter the same-type image of which the imaging number and the imagingfrequency satisfy the predetermined condition is previously uploaded tothe online storage in one image group of one user, it is suggested tothe product provider related to the same-type image information of thesame-type image of which the imaging number and the imaging frequencysatisfy the predetermined condition to suggest information on a productrelated to the same-type image information of the same-type image ofwhich the imaging number and the imaging frequency satisfy thepredetermined condition to the one user.

It is preferable that in a case where the imaging number and the imagingfrequency of the same-type images satisfy the predetermined condition inthe image groups of the plurality of users, it is suggested to theproduct provider related to the same-type image information of thesame-type image of which the imaging number and the imaging frequencysatisfy the predetermined condition to suggest the information on theproduct related to the same-type image information of the same-typeimage of which the imaging number and the imaging frequency satisfy thepredetermined condition to a similar-attribute user which does notupload the same-type image of which the imaging number and the imagingfrequency satisfy the predetermined condition and has an attributesimilar to the plurality of users.

The present invention provides a program causing a computer to executethe steps of the information suggestion method.

The present invention provides a non-transitory computer-readablerecording medium having a program causing a computer to execute thesteps of the information suggestion method recorded thereon.

The present invention provides an information suggestion systemcomprising an image group acquisition unit that acquires image groups ofa plurality of users stored in an online storage, an image analysis unitthat detects an imaging location of each image included in the imagegroups of the plurality of users and an object appearing in the eachimage by analyzing the each image, an imaging number count unit thatcounts an imaging number of a same-type image for each of same-typeimages which are captured at a same imaging location and in which a sameobject appears in the image groups of the plurality of users, an imagingfrequency calculation unit that calculates an imaging frequency of thesame-type images from the imaging number of the same-type images foreach of the same-type images in the image groups of the plurality ofusers, and an information suggestion unit that suggests same-type imageinformation related to the same imaging location and the same object ofa same-type image of which the imaging number and the imaging frequencysatisfy a predetermined condition to a product provider related to thesame-type image information among a plurality of product providers. Theimage group acquisition unit, the image analysis unit, the imagingnumber count unit, the imaging frequency calculation unit, and theinformation suggestion unit are hardware or processors that executeprograms.

The information suggestion system further comprises a region informationreception unit that receives information on a region which is providedfrom each of the plurality of product providers and corresponds to atleast one region of a geographical region or a business region in whichthe same-type image information is desired. The region informationreception unit is hardware or a processor that executes a program. It ispreferable that the information suggestion unit suggests the same-typeimage information of the same-type image of which the imaging number andthe imaging frequency satisfy the predetermined condition to a productprovider who provides information on a region corresponding to a regionincluding at least one of the same imaging location or the same objectof the same-type image of which the imaging number and the imagingfrequency satisfy the predetermined condition.

The information suggestion system further comprises an image extractionunit that extracts, as a region-related image, an image related to theinformation on the region from the image groups of the plurality ofusers. The image extraction unit is hardware or a processor thatexecutes a program. It is preferable that the imaging number count unitcounts the imaging number of the same-type images for each of thesame-type images in the region-related image or for attributes of theplurality of users in the region-related image and the imaging frequencycalculation unit calculates the imaging frequency of the same-typeimages from the imaging number of the same-type images for each of thesame-type images in the region-related image or for the attributes ofthe plurality of users in the region-related image.

The information suggestion system further comprises a suggestiondecision unit that decides whether or not to suggest the same-type imageinformation to the product provider related to the same-type imageinformation depending on whether or not the imaging number and theimaging frequency of the same-type images satisfy the predeterminedcondition in the region-related image or the attributes of the pluralityof users in the region-related image. The suggestion decision unit ishardware or a processor that executes a program. It is preferable thatthe information suggestion unit suggests the same-type image informationdecided to be suggested to the product provider related to the same-typeimage information decided to be suggested.

The information suggestion system further comprises a suggestion draftcreation unit that creates a suggestion draft including informationrelated to the same object of the same-type image of which the imagingnumber and the imaging frequency satisfy the predetermined condition anda condition for suggesting the same-type image information of thesame-type image of which the imaging number and the imaging frequencysatisfy the predetermined condition to one or more users. The suggestiondraft creation unit is hardware or a processor that executes a program.It is preferable that the information suggestion unit transmits thesuggestion draft to the product provider related to the same-type imageinformation of the same-type image of which the imaging number and theimaging frequency satisfy the predetermined condition.

According to the present invention, the same-type image information ofthe same-type image is suggested to the product provider related to thesame-type image information. Therefore, it is possible to suggest theinformation of interest to many users who upload the same-type image tothe product provider. In other words, the product provider can suggestthe information on the product of interest to many users who upload thesame-type image to the user.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of an embodiment showing a configuration of aninformation suggestion system according to an embodiment of the presentinvention.

FIG. 2 is a block diagram of an embodiment showing a configuration of aserver.

FIG. 3 is a flowchart of an embodiment showing an operation of theinformation suggestion system in a case where information is suggestedto one user.

FIG. 4 is a flowchart of an embodiment showing an operation of theinformation suggestion system in a case where information is suggestedto a product provider.

FIG. 5 is a flowchart of another embodiment showing the operation of theinformation suggestion system in a case where the information issuggested to the product provider.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, an information suggestion system, an information suggestionmethod, a program, and a recording medium according to an embodiment ofthe present invention will be described in detail based on preferredembodiments shown in the accompanying drawings.

FIG. 1 is a block diagram of an embodiment showing a configuration ofthe information suggestion system according to the embodiment of thepresent invention. An information suggestion system 10 shown in FIG. 1suggests information on a product to a user, and suggests informationfor suggesting information for suggesting the information on the productto the user to a product provider. The information suggestion systemcomprises a server 12, and a plurality of clients 14A and 14B connectedto the server 12 via a network 16.

The client 14A is a user client used by each of a plurality of users whouses the information suggestion system 10, and the client 14B is aproduct provider client used by each of a plurality of product providerswho also uses the information suggestion system 10.

The server 12 has a function of storing an image group which is uploadedfrom each user client 14A and is owned by each user in a storage regionof each user in an online storage, and a function of suggesting theinformation on the product to each user and suggesting the informationfor suggesting the information on the product to each user to eachproduct provider based on an analysis result of the image group of eachuser stored in the online storage.

The number of servers 12 is not limited to one, but a plurality ofservers may be used. The server is a workstation including a controldevice, a storage device, and a communication device.

The user client 14A has a function of uploading the image group selectedby each user from the image groups owned by the users to the server 12and a function of displaying information suggested by the server 12.

The product provider client 14B has a function of displaying theinformation suggested by the server 12 and a function of requesting theserver 12 to suggest the information on the product related to thisinformation to each user based on the information suggested by theserver 12.

Each of the clients 14A and 14B is a desktop personal computer (PC), alaptop PC, a tablet PC, or a portable terminal such as a portable phoneand a smartphone that includes a control device, an input device, astorage device, a communication device, and a display (display device).

The user is a consumer who purchases and uses various products, and theproduct provider is a company or a local government that suggestsinformation on various products to each user and sells the products. Inthe present invention, the product include intangible services inaddition to tangible articles.

Each user and each product provider can create each account before usingthe information suggestion system 10, and can use the informationsuggestion system 10 after logging in the information suggestion system10 based on their own account information.

The account information of the user includes information such as an age(year of birth), a gender, an address, a mail address, and a telephonenumber in addition to a user name (account name) and a password forlogin. The account information on the product provider includesinformation such as an address, an e-mail address, and a telephonenumber in addition to a user name and a password.

FIG. 2 is a block diagram of an embodiment showing a configuration ofthe server. The server 12 shown in FIG. 2 comprises an online storage18, an image group acquisition unit 20, an image analysis unit 22, aregion information reception unit 24, an image extraction unit 26, animaging number count unit 28, an imaging frequency calculation unit 30,an imaging purpose estimation unit 32, a suggestion informationregistration unit 34, a suggestion decision unit 36, a suggestion draftcreation unit 38, and an information suggestion unit 40.

A storage region for each user is provided in the online storage 18. Theonline storage 18 stores the image group of each user to be uploadedfrom each user client 14A to the server 12 in the storage region of eachuser.

The image group of each user may include images shared with other users,that is, images that are published to other users, or may include imagesthat are not shared with other users, that is, images that are notpublished to other users.

The image groups of the users stored in the online storage 18 can beused for various products and applications using the images such asphoto prints and photo albums.

Subsequently, the image group acquisition unit 20 acquires the imagegroup of one user stored in the online storage 18.

The image group acquisition unit 20 acquires the image groups of theplurality of users stored in the online storage 18. That is, a set ofimage groups including the image groups owned by the plurality of usersis acquired.

The image group acquisition unit 20 may acquire the image group of oneuser randomly selected from all users who use the information suggestionsystem 10, or may sequentially acquire the image groups of the users.For example, the image group acquisition unit may acquire the imagegroups of the plurality of users randomly selected from all the userswho use the information suggestion system 10, and may acquire the imagegroups of the plurality of users selected according to an attribute ofthe user such as the age, the gender, and the address such as a femalein her twenties resident in Tokyo.

The image group acquisition unit 20 may acquire the image group of oneuser and the image groups of the plurality of users for eachpredetermined period, or may acquire the image group whenever a newimage group is upload for each user and is stored in the online storage18.

The image group acquisition unit 20 is not limited to the online storage18, and may acquire the image group of each user from various storages,for example, a storage device of each user client 14A.

Subsequently, the image analysis unit 22 analyzes each image included inthe image group of one user acquired by the image group acquisition unit20, detects the attribute of each image, and detects a plurality ofattributes of a plurality of images included in the image group of oneuser. That is, a set of attributes including the attributes of theplurality of images is detected.

The image analysis unit 22 analyzes each image included in the imagegroup of the plurality of users acquired by the image group acquisitionunit 20, and detects an imaging location of each image and an objectappearing in each image.

An analysis item of the image is not particularly limited, and includes,for example, analysis of an image content such as detection of subjects(a person and an object other than the person) appearing in the image,detection of a face of the person, detection of an imaging direction ofthe image, detection of a scene (night view, sea, sand, sky, . . . ),and detection of an event (sports day, wedding ceremony, graduationceremony, . . . ), analysis of quality of the image such as brightness,hue, contrast, and a degree of blurriness of the image, and detection oftime information (imaging date and time) and positional information(Global Positioning System (GPS) information) (imaging location)included in accessory information of the image such as ExchangeableImage File Format (Exit). Only a part of the aforementioned analysis maybe performed, or an image analysis other than the aforementionedanalysis may be performed.

The attributes of the image include at least one of the imaging date andtime of the image, the imaging location of the image, the imagingdirection of the image, the person appearing in the image, the objectappearing in the image, and the scene appearing in the image. Theattributes of the image may include attributes other than theaforementioned attributes.

Subsequently, the region information reception unit 24 receivesinformation on a region corresponding to at least one of a geographicalregion or a business region in which information is desired which isprovided from each of the plurality of product providers.

The information on the region (geographical region and business region)limits images related to the products provided by the product providerin the image groups of the plurality of users.

The information on the geographical region limits the imaging locationof the image. For example, in a case where the product provider providesthe products in Tokyo, since images captured in locations other thanTokyo are unnecessary, the geographical region is limited to imagescaptured in Tokyo. In this case, the geographical region may be acountry-specific region. In a case where the geographical region is inJapan, the geographical region may be Honshu and Kyushu, may be EastJapan and West Japan, may be Kanto and Kinki, may be aprefecture-specific region, or may be a municipality-specific region.

The information on the business region limits a type of the objectappearing in the image. For example, in a case where the productprovider is a company in a confectionery industry, since an image inwhich an object other than confectionery appears is unnecessary, thebusiness region is limited to an image in which the confectioneryappears. In the confectionery industry, the business region may be namesof individual confectioneries such as “chocolate” and “candy”, or may becomprehensive names of “confectionery”, “Japanese confectionery”, and“Western confectionery”.

Subsequently, the image extraction unit 26 extracts, as a region-relatedimage, an image related to the information on the region received by theregion information reception unit 24 from the image groups of theplurality of users.

For example, the image extraction unit 26 extracts, as theregion-related image, an image in which the information related to atleast one of the imaging location of the image or the object appearingin the image is related to the information on the region provided byeach product provider.

For example, the image extraction unit 26 extracts, as theregion-related image, the image captured in Tokyo from the image groupsof the plurality of users in a case where the geographical region is inTokyo, and extracts, the region-related image, the image in which theconfectionery appears from the image groups of the plurality of users ina case where the business region is in the confectionery industry.

Subsequently, the imaging number count unit 28 counts the imaging numberof images of the same-attribute images (image group) for each attributeof the image detected by the image analysis unit 22 in the image groupof one user. In the present invention, the same-attribute image refersto the image group having the same attribute for each attribute of theimage. In other words, in a case where a certain one attribute isfocused, the same-attribute images are the image group of which oneattribute is the same content.

The imaging number count unit 28 counts the imaging number of same-typeimages for each image of the same-type image (image group) in the imagegroups of the plurality of users. In the present invention, thesame-type image refers to the image group which is captured in the sameimaging location and in which the same object appears. In other words,the same-type image is the image group of which two attributes such asthe imaging location of the image and the object appearing in the imageare the same contents. That is, the same-type image is the image groupconsisting of the same-attribute image of which the attribute such asthe imaging location of the image is the same content and thesame-attribute image of which the attribute such as the object appearingin the image is the same content.

In a case where the attribute is the imaging location of the image, theimaging number count unit 28 counts the imaging number of imagescaptured at the same imaging location such as the image captured inTokyo and the image captured in Osaka. In a case where the attribute isthe object appearing in the image, the imaging number count unit countsthe imaging number of images in which the same object appears such asthe image in which chocolate appears and the image in which candyappears.

The imaging number count unit 28 counts the imaging number of images ofthe same-type images which are captured in Kushiro-shitsugen NationalPark and in which Japanese crane appears.

Subsequently, the imaging frequency calculation unit 30 calculates theimaging frequency of the same-attribute images from the imaging numberof images of the same-attribute images counted by the imaging numbercount unit 28 for each attribute of the image in the image group of oneuser.

The imaging frequency calculation unit 30 calculates the imagingfrequency of the same-type images from the imaging number of thesame-type images for each same-type image counted by the imaging numbercount unit 28 in the image groups of the plurality of users.

In a case where the attribute is the imaging location of the image, forexample, the imaging frequency calculation unit 30 calculates theimaging frequency of the images as (3/5) in a case where the totalnumber of images included in one user's image group is five and thetotal number of images included in the image group of one user is fiveand the imaging number of images captured in Tokyo is three, andcalculates the imaging frequency of the images as (2/5) in a case wherethe imaging number of images captured in Osaka is 2. The same applies tothe case of the imaging frequency of the same-type images.

Subsequently, the imaging purpose estimation unit 32 estimates animaging purpose of the same-attribute image for each attribute of theimage. The imaging purpose estimation unit 32 sets the imaging purposeof the same-attribute image to the imaging purpose of each imageincluded in the same-attribute image (image group).

The method by which the imaging purpose estimation unit 32 estimates theimaging purpose of the same-attribute image is not particularly limited,and, for example, the imaging purpose of the same-attribute image can beestimated based on the attributes of the images and the analysis resultsof the images.

Subsequently, the suggestion information registration unit 34 registersone or more pieces of suggestion information in which the imagingpurpose and the information on the product are associated with eachother.

For example, one or more pieces of suggestion information provided fromeach of the plurality of product providers are recorded in thesuggestion information registration unit 34. For example, theinformation on the product is not particularly limited as long as theinformation related to the imaging purpose is used. However, in a casewhere the imaging purpose is, for example, the imaging of an image of ascene “sports”, information related to sports equipment such as baseballbats and gloves is considered. In a case where the imaging purpose isthe imaging of an image of “watching sports”, information related tosupporting goods such as a headband and a megaphone is considered.

The suggestion information is used in a case where the suggestiondecision unit 36 acquires the information on the product to be suggestedfrom the imaging purpose of the same-attribute image.

Subsequently, the suggestion decision unit 36 decides whether or not tosuggest the information on the product related to the imaging purpose ofthe same-attribute image to one user who owns the same-attribute imagedepending on whether or not the imaging number and the imaging frequencyof the same-attribute images satisfy a predetermined condition for eachattribute of the image.

The suggestion decision unit 36 decides whether or not to suggestsame-type image information related to the same imaging location of thesame object of the same-type images to the product provider related tothis same-type image information among the plurality of productproviders depending on whether or not the imaging number and the imagingfrequency of the same-type images which are captured in the same imaginglocation and in which the same object appears satisfy a predeterminedcondition in the region-related image extracted by the image extractionunit 26 or for the attributes of the plurality of users in theregion-related image.

A case where the predetermined condition is satisfied means that, forexample, the imaging number and the imaging frequency are equal to orlarger than threshold values. The threshold values of the imaging numberand the imaging frequency are not particularly limited, but thethreshold value of the imaging number can be, for example, 100, and thethreshold value of the imaging frequency can be, for example, (10/100)in a case where the imaging frequency is expressed by a ratio of(imaging number/total number of images included in image group). Forexample, in a case where it is assumed that the average number of imagesincluded in 100 images of a certain image group for all users is one anda standard deviation is three, the imaging number is the average numberof images+standard deviation×3=1+3×3=10, and the threshold value of theimaging frequency is (10/100) described above. First, the thresholdvalue of the imaging frequency for all the objects is obtained from theexpression consisting of the average number of images and the standarddeviation, but may be adjusted based on a behavior of the user for thesuggestion to the user to be described below. For example, in a casewhere the suggestion is performed to the user based on the thresholdvalue of the initial imaging frequency but is not linked to the behaviorof the user, the threshold value of the imaging frequency is increased,and thus, the suggestion to the user may be performed by narrowing downto the user who more frequently captures the object.

In a case where the imaging frequency is low even though the imagingnumber is large, or in a case where the imaging number is small eventhough the imaging frequency is high, it is difficult to correctlydetermine whether or not the same-attribute image matches hobby orpreference of one user or whether or not the same-type image isinformation of interest for many users. In order to perform the correctdetermination, the imaging number and the imaging frequency need tosatisfy a predetermined condition.

The attributes of the plurality of users include at least one of theage, the year of birth, the gender, or the address of the plurality ofusers. The attribute of the user can be acquired from the accountinformation of the user, for example. The attribute of the user mayinclude attributes other than the aforementioned attributes.

In a case where the imaging number and the imaging frequency of thesame-attribute images satisfy the predetermined condition, thesuggestion decision unit 36 decides to suggest the information on theproduct related to the imaging purpose of the same-attribute image toone user. Meanwhile, in a case where the imaging number and the imagingfrequency of the same-attribute images do not satisfy the predeterminedcondition, the suggestion decision unit 36 decides not to suggest theinformation on the product related to the imaging purpose of thesame-attribute image to one user.

In a case where the imaging number and the imaging frequency of thesame-type images satisfy the predetermined condition, the suggestiondecision unit 36 decides to suggest the same-type image information ofthis same-type image to the product provider related to this same-typeimage information. Meanwhile, in a case where the imaging number and theimaging frequency of the same-type images do not satisfy thepredetermined condition, the suggestion decision unit decides not tosuggest the same-type image information of the same-type image to theproduct provider related to this same-type image information.

Subsequently, the suggestion draft creation unit 38 creates a suggestiondraft including information on the same object of the same-type image ofwhich the imaging number and the imaging frequency satisfy thepredetermined condition and a suggestion condition for suggesting thesame-type image information of the same-type image of which the imagingnumber and the imaging frequency satisfy the predetermined condition toone or more users.

The suggestion draft is an example of the same-type image information,and is used, for example, in a case where the information suggestionunit 40 suggests the same-type image information to the productprovider.

The information on the object includes, for example, information such asa name of the object, a location of the object, and a description of theobject.

The suggestion conditions are not particularly limited. However, forexample, in a case where a predetermined period elapses after thesame-type image of which the imaging number and the imaging frequencysatisfy the predetermined condition is previously uploaded, thesuggestion condition includes a case where a specific condition issatisfied such as a case where the imaging number and the imagingfrequency of the same-type image satisfy the predetermined condition.

The information on the object and the suggestion condition may includeinformation and conditions other than the aforementioned information andconditions. The suggestion draft may include information other than theinformation on the object and the suggestion conditions, for example,suggestion contents to be suggested to the user.

The suggestion draft includes, for example, a suggestion of “Number ofphotos of Mt. Fuji is increasing. How about suggesting users who uploadphotos of Mt. Fuji going to Mt. Fuji?”. In this case, “Mt. Fuji” is theinformation on the object, “Photos of Mt. Fuji is increasing.” is thesuggestion condition, and “How about suggesting going to Mt. Fuji?” isthe suggestion content to be suggested to the user.

Subsequently, the information suggestion unit 40 suggests theinformation on the product decided to be suggested to one user by thesuggestion decision unit 36 to the one user.

The information suggestion unit 40 suggests the same-type imageinformation related to the same imaging location and the same object ofthe same-type image of which the imaging number and the imagingfrequency satisfy the predetermined condition to the product providerrelated to this same-type image information among the plurality ofproduct providers.

The suggestion method for the user and the product provider is notparticularly limited. For example, an e-mail related to the suggestionmay be transmitted to the user and the product provider, or theinformation of the suggestion may be displayed on the displays of theuser client 14A and the product provider client 14B.

Next, an operation of the information suggestion system 10 will bedescribed with reference to the flowcharts shown in FIGS. 3, 4, and 5 .First, a case where information is suggested to one user will bedescribed.

Each user instructs each user client 14A to select a desired image groupof the image groups owned by each user and upload the selected imagegroup to the server 12. Alternatively, each user may set toautomatically upload the image group stored in a predetermined folder ofthe storage device of each client 14A in the server 12.

Accordingly, the image group of each user selected by each user isuploaded to the server 12 from each user client 14A, and is stored inthe storage region of each user in the online storage 18.

In a case where the image groups of one or more users are stored in theonline storage 18, the image group acquisition unit 20 acquires theimage group of one user stored in the online storage 18 (step S11 ofFIG. 3 ).

Subsequently, the image analysis unit 22 analyzes each image included inthe image group of one user, detects an attribute of each image, anddetects a plurality of attributes of the images included in the imagegroup of one user (step S12 in FIG. 3 ).

Subsequently, the imaging number count unit 28 counts the imaging numberof the same-attribute images in the image group of one user for eachimage attribute (step S13 of FIG. 3 ).

Subsequently, the imaging frequency calculation unit 30 calculates theimaging frequency of the same-attribute images from the imaging numberof the same-attribute images in the image group of one user for eachattribute of the image (step S14 of FIG. 3 ).

The imaging purpose estimation unit 32 estimates the imaging purpose ofthe same-attribute image for each attribute of the image (step S15 ofFIG. 3 ). Any one or both of the calculation of the imaging number andthe imaging frequency and the estimation of the imaging purpose may beperformed first, or both may be processed in parallel.

Subsequently, the suggestion decision unit 36 decides whether or not tosuggest the information on the product related to the imaging purpose ofthe same-attribute image to one user who owns this same-attribute imagedepending on whether or not the imaging number and the imaging frequencyof the same-attribute images satisfy the predetermined condition foreach attribute of the image (step S16 of FIG. 3 ).

Subsequently, the information suggestion unit 40 suggests theinformation on the product decided to be suggested to one user to theone user (step S17 of FIG. 3 ).

In the case of the present embodiment, the suggestion decision unit 36searches for the suggestion information including an imaging purposematching the imaging purpose of the same-attribute image of which theimaging number and the imaging frequency satisfy the predeterminedcondition from the one or more pieces of suggestion informationregistered in the suggestion information registration unit 34.

Subsequently, the information suggestion unit 40 suggests theinformation on the product included in the suggestion informationsearched for by the suggestion decision unit 36 to one user.

For example, in a case where the imaging purpose is “travel”, theinformation suggestion unit 40 may suggest only one piece of informationsuch as “We recommend travel to XXX.” as the suggestion content.However, as a more preferable example, in a case where a message of “Icollectively recommend transportation unit, hotels, and touristattraction tickets for trip to XXX. Do you want to see? Yes or No” isdisplayed on the display of the user client 14A and “Yes” is selected bythe user, it is desirable that various services are subsequentlydisplayed in a list, and the user can collectively make reservations forvarious services.

A list of services suggested to the user can be created from, forexample, analysis results of images related to the past “XXX travel”stored in the online storage 18 by the user. The list of the servicescan be created from the analysis results of the image of the userrelated to the “XXX travel” stored in the online storage 18, the imaginglocation of the image related to “XXX travel” of the plurality of otherusers which is agreed, analyzed, and determined, and the objectappearing in the image.

Thereafter, in a case where the image group of each user is uploaded tothe server 12 and is stored in the storage region of each user in theonline storage 18, the image group of the user is sequentially acquired,and the aforementioned operation is similarly repeated for the imagegroup of each user.

Here, in a case where the image group shared (published) on, forexample, Facebook (registered trademark) among SNSs is analyzed, thehobby and the preference that the user who shares the image group wantsto share with friends are expressed, and in a case where the image groupshared in LINE (registered trademark) and WhatsApp (registeredtrademark) is analyzed, the hobby and the preference that the user wantsto share with more close friends and family which is only each talkmember are expressed.

In a case where a purchase history of the user in online shops such asAmazon.com (registered trademark) and Rakuten Ichiba (registeredtrademark) is analyzed, the hobby and the preference related to theproducts purchased by the user are expressed.

However, there are no methods that can widely express the hobby and thepreference of the user by one application or web service. At present,since smartphones have become widespread, various images of interest tousers have been captured and stored by built-in cameras. In a case wherethere is an application or a web service that can integrally view theimage groups of the user, the hobby and the preference of the user maybe widely displayed.

Meanwhile, in an initial state, the image group of the user may bemerely arranged in chronological order in general. In a case where suchan image group is analyzed in complete harmony, it is considered thatthe estimation of the hobby and the preference of the user is notsuccessful.

Meanwhile, in the information suggestion system 10, the imaging purposeestimation unit 32 estimates the imaging purpose of the same-attributeimage, and thus, the hobby and the preference of the user can beestimated from the imaging purpose for each same-attribute image.

In a case where the attribute is the imaging location, the imagingpurpose estimation unit 32 estimates that the imaging purpose of thesame-attribute image captured near the user home is, for example, theimaging of an image of “daily”. It is estimated that the imaging purposeof the same-attribute image captured at a location slightly away fromhome is the imaging of an image of an unusual “event”, and the imagingpurpose of the same-attribute image captured at a place far away fromhome is the imaging of an image of “travel”.

In a case where the attribute is the person appearing in the image, theimaging purpose estimation unit 32 estimates that the imaging purpose ofthe same-attribute image in which the person is not a main subject, forexample, for a certain time zone is the imaging of a “personal” image.It is estimated that the imaging purpose of the same-attribute image inwhich family appears is the imaging of a “family-like” image and theimaging purpose of the same-attribute image in which a person other thanthe family appears is the imaging of an image of a “friendrelationship”.

For example, even though a scene of the image is detected and it isdetermined that the image is related to baseball, whether the user whoowns the image is playing baseball or likes watching baseball gamescannot be determined by only the image related to the baseball.

In this case, in a case where the attribute is the object appearing inthe image and several friends of the user appear in the image, sincethere is a high possibility that the user is playing baseball, theimaging purpose estimation unit 32 estimates that the imaging purpose ofthe image is the imaging of the image of the scene such as “playsports”. In a case where the image is captured at a famous baseballstadium or a famous baseball player appears in the image, it isestimated that the user likes watching baseball games, and the imagingpurpose of the image is the imaging of the image of “watching sports”.

As described above, the information suggestion system 10 estimates theimaging purpose of the same-attribute images for each attribute of theimage, and suggests the information on the product related to theimaging purpose of the same-attribute images to the user. Therefore, thepersonal hobby and preference of the user, the hobby and preferenceshared with friends, or the hobby and preference that family memberslike can be appropriately determined from the imaging purpose of thesame-attribute image, the hobby and preference of the user can be widelyand appropriately estimated, and the information on the correspondingproduct can be appropriately suggested.

Example 1

It is assumed that a plurality of images (photos) of “Japanese crane inwinter” is included in the image group of one user. It is consideredthat the imaging purpose is the imaging of an image of “Japanese crane”or “Japanese crane in winter”. There is a high possibility that theimage of “Japanese crane” is captured in Kushiro-shitsugen NationalPark. It is expected that the user who captures such an image is thehobby of photography and possesses expensive camera equipment. It isconsidered that there is a possibility that many users who capture“Japanese crane in winter” visit, stay, and sightsee Kushiro again inthe winter of the next year.

In this case, Kushiro city and Kushiro Tourism Association are assumedas the product providers. In a case where it is near the season in which“Japanese crane in winter” visits in the next winter, touristinformation of Kushiro city and information on accommodation facilitiesare suggested to one user who has a plurality of images of “Japanesecrane in winter” in the image group. Further, information on cameraequipment of a new product may be suggested to the one user from a salescompany of the camera equipment as the product provider.

Example 2

It is assumed that a plurality of images (photos) of the scene of “ski”is included in the image group of one user. It is also assumed that theimages of the scene of “ski” are included not only for a single year butfor a plurality of years. It is considered that the imaging purpose isthe imaging of the image of the scene of “ski”. There is a possibilitythat the hobby of the user is going skiing every year.

In this case, a ski resort operating company is assumed as the productprovider. In a case where it is near the ski season in the next year,information on a ski resort and accommodation facilities is suggested toone user in which many images of the scene of “ski” are included in theimage group.

Example 3

It is assumed that a plurality of images (photos) of “TDL (TokyoDisneyland (registered trademark))” is included in the image group ofone user. It is also assumed that the images of “TDL” are included notin a single year but in a plurality of years. It is considered that theimaging purpose is the imaging of the image of “TDL”. There is a highpossibility that the user likes “TDL” and goes to “TDL” every year.

In this case, a travel company is assumed as the product provider.Information on a travel plan to “TDL” is suggested to one user in whichmany images of “TDL” are included in the image group.

Example 4

It is assumed that a plurality of images (photos) of “railway” isincluded in the image group of one user. It is considered that theimaging purpose is the imaging of the image of “railway”. There is ahigh possibility that the user likes railways and goes to railways invarious places to capture the images of “railways”.

In this case, a travel company is assumed as the product provider.Information related to an imaging location of the railway as a newimaging spot and a type (steam locomotive or train) of a railway vehiclewhich does not appear in the image included in the image group of oneuser is suggested to one user in which many images of “railway” areincluded in the image group.

In a case where the information on the product to be suggested to theuser includes information on a product related to a periodic event thatoccurs at a certain cycle, the information suggestion unit 40 maysuggest the information on the product related to the periodic event toone user before a predetermined period from a timing at which the nextperiodic event occurs.

The periodic event may include, for example, purchase of dailynecessities such as shampoo and rinse, and reservation for the travel,but may include other events.

Accordingly, it is possible to periodically suggest the purchase of theproduct to be periodically purchased by one user to one user before oneuser purchases the product, and it is possible to promote the sale ofthe product.

The suggestion information registration unit 34 may register, as one ormore pieces of suggestion information, suggestion information in whichtwo or more imaging purposes and pieces of information on the productsare associated with each other.

In this case, the suggestion decision unit 36 searches for thesuggestion information including two or more imaging purposes matchingtwo or more imaging purposes of two or more same-attribute images ofwhich the imaging number and the imaging frequency satisfy thepredetermined condition.

Accordingly, it is possible to suggest information on a productcorresponding to a combination of two or more imaging purposes to oneuser. For example, in a case where the imaging purposes are two types ofimaging of a winter image and imaging of an image of the Japanese crane,information on a product related to the Japanese crane in winter can besuggested to one user.

In a case where the imaging purpose is the imaging of an objectpredetermined by the information suggestion system 10, the suggestiondecision unit 36 may decide to suggest the information on the productrelated to the imaging purpose of the image on which the predeterminedobject is captured to the user regardless of whether or not thepredetermined condition is satisfied.

Accordingly, it is possible to immediately suggest the information onthe product related to the imaging purpose of the image in which thepredetermined object is captured to the user who uploads the imageregardless of the imaging number and the imaging frequency. For example,in a case where the predetermined object is the Japanese crane, theinformation on the product related to the Japanese crane is immediatelysuggested to the user who uploads the image of the Japanese crane.

The predetermined object is not particularly limited, and may be anyobject such as an unusual object or an object requested by the productprovider.

The imaging purpose estimation unit 32 may create a learned model whichlearns a relationship between the imaging number, the imaging frequency,and the imaging purpose of a learning same-attribute images having thesame attribute in advance for a plurality of sets of learningsame-attribute images, and may estimate the imaging purpose of thesame-attribute image from the same-attribute image by using the learnedmodel.

Accordingly, it is possible to more accurately estimate the imagingpurpose of the same-attribute image from the same-attribute image as thenumber of sets of the learning same-attribute images increases.

In a case where the learned model is created, information on the imagingpurpose corresponding to the imaging number and the imaging frequency ofthe learning same-attribute images is provided for the plurality of setsof learning same-attribute images. For example, in a case where theinformation on the product related to the imaging purpose is suggestedto the user and the user purchases the product corresponding to theinformation on this product, it possible to determine that this imagingpurpose is correct, and in a case where the user does not purchase theproduct corresponding to the information on this product, it is possibleto determine that this imaging purpose is not correct.

For example, a learned model consisting of a neural network can becreated as the learned model.

In this case, for example, the imaging purpose estimation unit 32performs change processing for changing a coefficient of each nodeconstituting the neural network such that an output error based on theimaging purpose output in a case where the imaging number and theimaging frequency of the plurality of sets or one set of learningsame-attribute images are input is minimized in a case where the imagingnumber and the imaging frequency of one set of learning same-attributeimages and the information on the imaging purpose corresponding to theimaging number and the imaging frequency of the one set of learningsame-attribute images are acquired. For example, in a case where animaging purpose 1 is the imaging of the image of the person, the changeprocessing is performed such that an output error based on the imagingpurpose 1 is minimized, and in a case where an imaging purpose 2 is theimaging of an image of animal, the change processing is performed suchthat an output error based on the imaging purpose 2 is minimized.

The imaging purpose estimation unit 32 learns the relationship betweenthe imaging number and the imaging frequency of the learningsame-attribute images by repeatedly performing the above-describedchange processing. Accordingly, it is possible to create a learned modelin which the coefficient of each node constituting the neural network ischanged such that the output error based on each imaging purposecorresponding to the imaging number and the imaging frequency isminimized. For example, the coefficient of each node constituting theneural network is changed such that the output errors based on theimaging purpose 1 and the imaging purpose 2 for the imaging number andthe imaging frequency is minimized.

The imaging purpose estimation unit 32 estimates that the imagingpurpose of which the output error is minimized is the most accurateimaging purpose for the imaging number and the imaging frequency of thesame-attribute images by using the learned model.

A learning method in a case where the learned model is created is notparticularly limited as long as a method that can learn the relationshipbetween the imaging number, the imaging frequency, and the imagingpurpose from the plurality of learning same-attribute images andgenerate the learned model is used.

As described above, for example, deep learning that uses a hierarchicalneural network as one example of machine learning which is one oftechnologies of artificial intelligence (AI) can be used as the learningmethod.

Machine learning other than the deep learning may be used, an artificialintelligence technology other than the machine learning may be used, ora learning method other than artificial intelligence technology may beused.

Next, a case where information is suggested to the product provider willbe described.

In a case where the image groups of the plurality of users are stored inthe online storage 18, the image groups of the plurality of users storedin the online storage 18 are acquired by the image group acquisitionunit 20 (step S21 of FIG. 4 ).

Subsequently, the image analysis unit 22 analyzes each image included inthe image group of the plurality of users, and detects the imaginglocation of each image and the object appearing in each image (step S22of FIG. 4 ).

Subsequently, the imaging number count unit 28 counts the imaging numberof the same-type images in the image groups of the plurality of usersfor each same-type image (step S23 of FIG. 4 ).

Subsequently, the imaging frequency calculation unit 30 calculates theimaging frequency of the same-type images from the imaging number ofsame-type images for each same-type image in the image groups of theplurality of users (step S24 of FIG. 4 ).

Subsequently, the information suggestion unit 40 suggests the same-typeimage information of the same-type image of which the imaging number andthe imaging frequency satisfy the predetermined condition to the productprovider related to the same-type image information (step S25 of FIG. 4).

The product provider can simultaneously suggest the information on theproduct related to the same-type image information to one or more users,for example, a plurality of users who uploads the same-type image.

In the information suggestion system 10, the same-type image informationof the same-type image is suggested to the product provider related tothe same-type image information as described above. Therefore, it ispossible to suggest the information of interest to many users who uploadthe same-type image to the product provider. In other words, the productprovider can suggest the information on the product of interest to manyusers who upload the same-type image to the user.

For example, in a case where the local government is worried about “Wewant to make some kind of sightseeing appeal for this town, but we donot know what is the appeal point of this town.”, it is possible tosuggest the information related to the imaging location in which theimaging number is large and the object of which the imaging number islarge for this town from the analysis result of the image groups of theplurality of users stored in the online storage 18 to the localgovernment, and it is possible to help the local government to make thesightseeing appeal.

Example 5

It is assumed that a plurality of images of “a location used in thedrama of City A” is included in the image groups of the plurality ofusers. In recent years, persons have come to this location, and thenumber of persons who captures this location has been increased. It canbe seen from the analysis result of the image groups of the plurality ofusers that the number of who captures the photos at this location isincreased.

From this case, “How about making the location a tourist spot?” issuggested to City A. The “location” is the same imaging location of thesame-type image information, “City A” is the product provider, and “Howabout making the location as a tourist spot?” is the same-type imageinformation.

Example 6

It is assumed that the image group of one user does not include an image(photo) of “railway” of City B but image groups of a plurality of otherusers include a plurality of images of “railway” of City B.

In this case, information for suggesting the information on the productrelated to “railway” (steam locomotive or train) of City B to the oneuser is suggested to the product provider related to the information onthe product. For example, information such as transportation unit toCity B and accommodation information in City B which are considered tobe necessary for capturing the image of “railway” in B city is suggestedto the travel agency.

Example 7

The imaging location of each image included in the image groups of theplurality of users is specified by utilizing the positional informationincluded in the accessory information of the image and the informationsuch as a landmark appearing in the image, and the information of thespecified imaging location of the image and the information of theobject appearing in this image are associated with each other. It isassumed that an object appearing in a plurality of images included inimage groups of other multiple users does not appear in the imageincluded in the image group of one user.

In this case, the information for suggesting the information on theproduct related to the imaging location of the image in which the objectappears to one user is suggested to the product provider related to theinformation on this product.

Each product provider can provide information on a region in which thesame-type image information is desired to the server 12.

In this case, the region information reception unit 24 receives theinformation on the region provided by each product provider (Step S31 ofFIG. 5 ).

Subsequently, the image extraction unit 26 extracts, as theregion-related image, the image related to the information on the regionprovided by one product provider from the image groups of the pluralityof users (step S32 of FIG. 5 ).

It is assumed that the analysis of each image is already ended.

Since the region-related image is the image related to each productprovider among the image groups of the plurality of user, the subsequentprocessing can be rapidly performed on the region-related image byprocessing the region-related image rather than processing the imagegroups of the plurality of users.

Subsequently, the imaging number count unit 28 counts the imaging numberof the same-type image for each same-type image in the region-relatedimage or for the attributes of the plurality of users in theregion-related image (step S33 of FIG. 5 ).

Subsequently, the imaging frequency calculation unit 30 calculates theimaging frequency of the same-type images from the imaging number of thesame-type images for each same-type image in the region-related image orfor the attributes of the plurality of users in the region-related image(step S34 of FIG. 5 ).

Subsequently, the information suggestion unit 40 suggests the same-typeimage information of the same-type image of which the imaging number andthe imaging frequency satisfy the predetermined condition to the productprovider that provides the information of the region corresponding tothe region including at least one of the same imaging location or thesame object of the same-type image of which the imaging number and theimaging frequency satisfy the predetermined condition (step S35 of FIG.5 ).

Thereafter, similarly, the information on the region provided by eachproduct provider is sequentially acquired, and the aforementionedoperation is repeated for the region-related image related to theinformation on the region provided by each product provider.

The suggestion decision unit 36 may decide whether or not to suggest thesame-type image information of the same-type image to the productprovider related to this same-type image information among the pluralityof product providers depending on whether or not the imaging number andthe imaging frequency of the same-type images satisfy the predeterminedcondition in the region-related image or for the attributes of theplurality of users in the region-related image.

In this case, the information suggestion unit 40 suggests the same-typeimage information decided to be suggested to the product providerrelated to the same-type image information decided to be suggested.

In a case where the imaging number and the imaging frequency of thesame-type image satisfy the predetermined condition, the suggestiondraft creation unit 38 may create the suggestion draft related to thesame-type image of which the imaging number and the imaging frequencysatisfy the predetermined condition.

In this case, the information suggestion unit 40 transmits thesuggestion draft to the product provider related to the same-type imageinformation of the same-type image of which the imaging number and theimaging frequency satisfy the predetermined condition.

The information suggestion unit 40 may transmit on suggestion draftselected among the plurality of existing suggestion drafts or thesuggestion draft created by the person to the product provider inaddition to the suggestion draft created by the suggestion draftcreation unit 38.

The product provider related to the same-type image information canprovide a condition for suggesting the information on the productrelated to the same-type image information to one or more users to theserver 12 based on the suggestion draft, and can request the server 12to suggest the information on the product related to the same-type imageinformation to one or more users.

In this case, the information suggestion unit 40 suggests theinformation on the product related to the same-type image informationbased on the condition which is provided by each of the plurality ofproduct providers to suggest the information on the product related tothe same-type image information to one or more users.

Each product provider may directly suggest the information to each userinstead of requesting the server 12 to suggest the information to theuser. Each product provider may register the suggestion informationobtained by associating the same-type image with the information on theproduct related to the same-type image information of this same-typeimage in the suggestion information registration unit 34. Accordingly,it is possible to acquire the information on the product related to thesame-type image information of this same-type image from the suggestioninformation registration unit 34 based on the same-type image of whichthe imaging number and the imaging frequency satisfy the predeterminedcondition.

In a case where a predetermined period elapses after the same-type imageof which the imaging number and the imaging frequency satisfy thepredetermined condition is previously uploaded to the online storage 18in the image group of one user, the information suggestion unit 40 maysuggest that the product provider related to the same-type imageinformation of the same-type image in which the imaging number and theimaging frequency satisfy the predetermined condition suggests theinformation on the product related to the same-type image information ofthe same-type image in which the imaging number and the imagingfrequency satisfy the predetermined condition to one user.

Accordingly, the product provider can periodically suggest theinformation on the product related to the same-type image information ofthe same-type image to one user. Since one user who uploads thesame-type image is considered to be interested in the information on theproduct related to the same-type image information of the same-typeimage, it is possible to promote the sale of the product.

The predetermined period can be appropriately decided according to thesuggestion content.

For example, when images uploaded by a user who is uploading the imagescaptured at a travel destination are the same-type images of which theimaging number and the imaging frequency satisfy the predeterminedcondition and the predetermined period elapses after the image ispreviously uploaded by the user, the information suggestion unitsuggests the product provider of the travel agency that the user issuggested to travel to the same travel destination as the previous time.

Accordingly, for example, in a case where one year elapses after theimage is previously uploaded by the user, the product provider requeststhe server 12 to suggest information on a travel to the same traveldestination as the previous time.

Accordingly, it is possible to suggest the information on the product bytargeting a repeater that regularly makes a reservation such as atravel.

The information suggestion unit 40 may suggest that the product providerrelated to the same-type image information of the same-type image ofwhich the imaging number and the imaging frequency satisfy thepredetermined condition suggests the information on the product relatedto the same-type image information of the same-type image of which theimaging number and the imaging frequency satisfy the predeterminedcondition to a user having a similar attribute which does not upload thesame-type image of which the imaging number and the imaging frequencysatisfy the predetermined condition in a case where the imaging numberand the imaging frequency of the same-type images satisfy thepredetermined condition in the image groups of the plurality of users.

The user having the similar attribute includes a user having attributes,for example, the age, the year of birth, the gender, and the addresssimilar to the plurality of users, or a user who captures similarimages, for example, a cat image, a train image, a flower image.

Accordingly, the product provider can suggest the information on theproduct related to the same-type image information of the same-typeimage to the user having the similar attribute. Since the user havingthe similar attribute is considered to be interested in the informationon the product related to the same-type image information of thesame-type image, it is possible to promote the sale of the product.

For example, in a case where the imaging frequency of the same-typeimages captured by the plurality of users at a certain imaging locationexceeds a threshold value, the information suggestion unit suggests thatthe product provider such as the travel agency suggests the travel tothis imaging location to the user having the similar attribute who doesnot upload the same-type image.

Accordingly, the product provider requests the server 12 to immediatelysuggest, for example, the information on the travel to the imaginglocation to the user having the similar attribute.

Accordingly, the information on the product can be suggested to the userhaving the similar attribute, that is, an inexperienced user who doesnot capture the same-type image captured by the plurality of users, thatis, who has not gone to the imaging location at which the same-typeimage is captured as a target.

From the viewpoint of protection of personal information, it is assumedthat the following items 1 to 4 are implemented in a case where theinformation suggestion system 10 is operated.

1. It is assumed that the administrator of the information suggestionsystem 10 obtains the agreement of the user about the analysis of theimage group of the user stored in the online storage 18 and thesuggestion of various pieces of information to the user and the productprovider from the analysis result.

2. It is assumed that the information suggestion system 10 obtains theagreement of the user about whether a subject that suggests theinformation on the product to the user is the information suggestionsystem or the product provider.

3. It is assumed that the information suggestion system obtains theagreement of the user about the delivery of information necessary tosuggest the information on the product to the user to the productprovider in the case where the subject of (2) described above is theproduct provider. It is preferable that the necessary information isminimum necessary information such as only an e-mail address.

4. It is assumed that the information suggestion system does not provideinformation of the user and information with which the user is specifiedin a case where the information is provided such as a case where theimage groups of the plurality of users are analyzed and the informationon the object of which the imaging number is large is transmitted to theproduct provider. It is assumed that the information suggestion systemobtains the agreement of the user in advance about the providing of theinformation after anonymizing such information.

In the device according to the present invention, for example, ahardware configuration of processing units that execute variousprocessing such as the image group acquisition unit 20, the imageanalysis unit 22, the region information reception unit 24, the imageextraction unit 26, the imaging number count unit 28, the imagingfrequency calculation unit 30, the imaging purpose estimation unit 32,the suggestion information registration unit 34, the suggestion decisionunit 36, the suggestion draft creation unit 38, and the informationsuggestion unit 40 may be dedicated hardware or may be variousprocessors or computers that execute programs.

Various processors include a central processing unit (CPU) which is ageneral purpose processor functioning as various processing units byexecuting software (program), a programmable logic device (PLD) which isa processor capable of changing a circuit configuration after a fieldprogrammable gate array (FPGA) is manufactured, and a dedicated electriccircuit which is a processor having a circuit configuration designed asa dedicated electric circuit in order to perform specific processingsuch as application specific integrated circuit (ASIC).

One processing unit may be constituted by one of the various processors.One processing unit may be obtained by combining the same kind ordifferent kinds of two or more processors, for example, by combining aplurality of FPGAs, or may be obtained by combining the FPGA and theCPU. The plurality of processing units may be constituted by one of thevarious processors or may be constituted by using one processor obtainedby combining two or more of the plurality of processing units.

For example, one processor is constituted by combining one or more CPUsand software so as to be represented by the computers such as the serverand the client, and this processor functions as the plurality ofprocessing units. A processor that realizes the functions of the entiresystem including the plurality of processing units by using oneintegrated circuit (IC) chip is used so as to be represented by a systemon chip (SoC).

More specifically, the hardware configuration of the various processorsis an electric circuitry obtained by combining circuit elements such assemiconductor elements.

For example, a method according to the embodiment of the presentinvention can be implemented by a program causing a computer to executesteps. It is possible to provide a computer-readable recording mediumhaving the program recorded thereon.

While the present invention has been described in detail, the presentinvention is not limited to the embodiment, and may be modified andchange in various manners without departing the gist of the presentinvention.

EXPLANATION OF REFERENCES

-   -   10: information suggestion system    -   12: server    -   14A: user client    -   14B: product provider client    -   16: network    -   18: online storage    -   20: image group acquisition unit    -   22: image analysis unit    -   24: region information reception unit    -   26: image extraction unit    -   28: imaging number count unit    -   30: imaging frequency calculation unit    -   32: imaging purpose estimation unit    -   34: suggestion information registration unit    -   36: suggestion decision unit    -   38: suggestion draft creation unit    -   40: information suggestion unit

What is claimed is:
 1. An information suggestion system comprising aprocessor, wherein the processor: acquires image groups of a pluralityof users stored in a storage; detects an object appearing in each imageincluded in the image groups of the plurality of users; counts animaging number of a same-type image for each of same-type images whichare captured at a same imaging location or in which a same objectappears in the image groups of the plurality of users; calculates animaging frequency of the same-type images from the imaging number of thesame-type images for each of the same-type images in the image groups ofthe plurality of users; and decides a product provider to whichsame-type image information related to the same imaging location or thesame object of a same-type image of which the imaging number and theimaging frequency satisfy a predetermined condition is suggested fromamong a plurality of product providers, and suggests the same-type imageinformation to the decided product provider.
 2. The informationsuggestion system according to claim 1, wherein the processor furtherreceives information on a region which is provided from each of theplurality of product providers and corresponds to at least one region ofa geographical region or a business region in which the same-type imageinformation is desired, and suggests the same-type image information ofthe same-type image of which the imaging number and the imagingfrequency satisfy the predetermined condition to a product provider whoprovides information on a region corresponding to a region including thesame imaging location or the same object of the same-type image of whichthe imaging number and the imaging frequency satisfy the predeterminedcondition.
 3. The information suggestion system according to claim 2,wherein the processor further extracts, as a region-related image, animage related to the information on the region from the image groups ofthe plurality of users, counts the imaging number of the same-typeimages for each of the same-type images in the region-related image orfor attributes of the plurality of users in the region-related image,and calculates the imaging frequency of the same-type images from theimaging number of the same-type images for each of the same-type imagesin the region-related image or for the attributes of the plurality ofusers in the region-related image.
 4. The information suggestion systemaccording to claim 3, wherein the processor extracts, as theregion-related image, an image in which information related to animaging location of the image or an object appearing in the image isrelated to the information on the region.
 5. The information suggestionsystem according to claim 3, wherein the attributes of the plurality ofusers include at least one of ages, years of birth, genders, oraddresses of the plurality of users.
 6. The information suggestionsystem according to claim 3, wherein the processor further decideswhether or not to suggest the same-type image information to the productprovider related to the same-type image information depending on whetheror not the imaging number and the imaging frequency of the same-typeimages satisfy the predetermined condition in the region-related imageor for the attributes of the plurality of users in the region-relatedimage, and suggests the same-type image information decided to besuggested to the product provider related to the same-type imageinformation decided to be suggested.
 7. The information suggestionsystem according to claim 1, wherein the processor further creates asuggestion draft including information related to the same object of thesame-type image of which the imaging number and the imaging frequencysatisfy the predetermined condition and a condition for suggesting thesame-type image information of the same-type image of which the imagingnumber and the imaging frequency satisfy the predetermined condition toone or more users, and transmits the suggestion draft to the productprovider related to the same-type image information of the same-typeimage of which the imaging number and the imaging frequency satisfy thepredetermined condition.
 8. The information suggestion system accordingto claim 7, wherein the processor suggests information on a productrelated to the same-type image information to one or more users based ona condition which is provided from each of the plurality of productproviders and for suggesting the information on the product related tothe same-type image information to the one or more users.
 9. Theinformation suggestion system according to claim 1, wherein, in a casewhere a predetermined period elapses after the same-type image of whichthe imaging number and the imaging frequency satisfy the predeterminedcondition is previously uploaded to the storage in one image group ofone user, the processor suggests to the product provider related to thesame-type image information of the same-type image of which the imagingnumber and the imaging frequency satisfy the predetermined condition tosuggest information on a product related to the same-type imageinformation of the same-type image of which the imaging number and theimaging frequency satisfy the predetermined condition to the one user.10. The information suggestion system according to claim 1, wherein, ina case where the imaging number and the imaging frequency of thesame-type images satisfy the predetermined condition in the image groupsof the plurality of users, the processor suggests to the productprovider related to the same-type image information of the same-typeimage of which the imaging number and the imaging frequency satisfy thepredetermined condition to suggest information on the product related tothe same-type image information of the same-type image of which theimaging number and the imaging frequency satisfy the predeterminedcondition to a similar-attribute user which does not upload thesame-type image of which the imaging number and the imaging frequencysatisfy the predetermined condition and has an attribute similar to theplurality of users.
 11. An information suggestion method in which aprocessor performs: acquiring image groups of a plurality of usersstored in a storage; detecting an object appearing in each imageincluded in the image groups of the plurality of users; counting animaging number of a same-type image for each of same-type images whichare captured at a same imaging location or in which a same objectappears in the image groups of the plurality of users; calculating animaging frequency of the same-type images from the imaging number of thesame-type images for each of the same-type images in the image groups ofthe plurality of users; and deciding a product provider to whichsame-type image information related to the same imaging location or thesame object of a same-type image of which the imaging number and theimaging frequency satisfy a predetermined condition is suggested fromamong a plurality of product providers, and suggesting the same-typeimage information to the decided product provider.
 12. The informationsuggestion method according to claim 11, wherein the processor furtherperforms receiving information on a region which is provided from eachof the plurality of product providers and corresponds to at least oneregion of a geographical region or a business region in which thesame-type image information is desired, and wherein the same-type imageinformation of the same-type image of which the imaging number and theimaging frequency satisfy the predetermined condition is suggested to aproduct provider who provides information on a region corresponding to aregion including the same imaging location or the same object of thesame-type image of which the imaging number and the imaging frequencysatisfy the predetermined condition.
 13. The information suggestionmethod according to claim 12, wherein the processor further performsextracting, as a region-related image, an image related to theinformation on the region from the image groups of the plurality ofusers, wherein the imaging number of the same-type images is counted foreach of the same-type images in the region-related image or forattributes of the plurality of users in the region-related image, andthe imaging frequency of the same-type images is calculated from theimaging number of the same-type images for each of the same-type imagesin the region-related image or for the attributes of the plurality ofusers in the region-related image.
 14. The information suggestion methodaccording to claim 13, wherein an image in which information related toan imaging location of the image or an object appearing in the image isrelated to the information on the region is extracted as theregion-related image.
 15. The information suggestion method according toclaim 13, wherein the processor further performs deciding whether or notto suggest the same-type image information to the product providerrelated to the same-type image information depending on whether or notthe imaging number and the imaging frequency of the same-type imagessatisfy the predetermined condition in the region-related image or theattributes of the plurality of users in the region-related image, andwherein the same-type image information decided to be suggested issuggested to the product provider related to the same-type imageinformation decided to be suggested.
 16. The information suggestionmethod according to claim 11, wherein the processor further performscreating a suggestion draft including information related to the sameobject of the same-type image of which the imaging number and theimaging frequency satisfy the predetermined condition and a conditionfor suggesting the same-type image information of the same-type image ofwhich the imaging number and the imaging frequency satisfy thepredetermined condition to one or more users, and wherein the suggestiondraft is transmitted to the product provider related to the same-typeimage information of the same-type image of which the imaging number andthe imaging frequency satisfy the predetermined condition.
 17. Theinformation suggestion method according to claim 16, wherein informationon a product related to the same-type image information is suggested toone or more users based on a condition which is provided from each ofthe plurality of product providers and for suggesting the information onthe product related to the same-type image information to the one ormore users.
 18. The information suggestion method according to claim 11,wherein, in a case where a predetermined period elapses after thesame-type image of which the imaging number and the imaging frequencysatisfy the predetermined condition is previously uploaded to thestorage in one image group of one user, it is suggested to the productprovider related to the same-type image information of the same-typeimage of which the imaging number and the imaging frequency satisfy thepredetermined condition to suggest information on a product related tothe same-type image information of the same-type image of which theimaging number and the imaging frequency satisfy the predeterminedcondition to the one user.
 19. The information suggestion methodaccording to claim 11, wherein, in a case where the imaging number andthe imaging frequency of the same-type images satisfy the predeterminedcondition in the image groups of the plurality of users, it is suggestedto the product provider related to the same-type image information ofthe same-type image of which the imaging number and the imagingfrequency satisfy the predetermined condition to suggest the informationon the product related to the same-type image information of thesame-type image of which the imaging number and the imaging frequencysatisfy the predetermined condition to a similar-attribute user whichdoes not upload the same-type image of which the imaging number and theimaging frequency satisfy the predetermined condition and has anattribute similar to the plurality of users.
 20. A non-transitorycomputer-readable recording medium having a program causing a computerto execute the steps of the information suggestion method according toclaim 11 recorded thereon.